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ACCELERATING A DISTRIBUTED An additional factor contributing to the speed difference 

COMPONENT ARCHITECTURE OVER A between a call to an object resident on the same machine and 

NETWORK USING A MODIFIED RPC one resident on a remote machine is the overhead created by 

COMMUNICATION DCOM and the RPC model. RPC marshals pointers and data 

5 to be transmitted across the network by reading them from 

CROSS-REFERENCE TO RELATED the program memory and packaging them for transportation 

APPLICATION across the network. Marshaling introduces delay because it 

„ . ... . , ~ _ TT 0 _ copies from program memory into an RPC buffer the ele- 

Tfcis application claims the benefit of U.S. Provisional men , ft ^ be Uinsmitted across me network . 

Apphcauon Ser. No. 60/111,788 filed Dec. 11, 1998. JQ aspect of , he overhead of DC0M ^ Rpc are ^ rantim6 

TECHNICAL FIELD layers. The RPC and DCOM runtime layers bridge together 

the client and server so that the client can make remote calls 
This invention relates generally to software communica- to the server. This process of bridging the client and server 
tion over a network and, more particularly, relates to accel- together is known as binding. Binding information can 
eration of the interaction of objects over a network. 15 include the Internet Protocol (IP) address, the port number, 

and the interface identifier (IID). 
BACKGROUND OF THE INVENTION The combined effects of the marshaling, the additional 

A component object model defines the interactions f ackets ot *!" and the activities of the runtime 

between computer software components. The advantage of , n ^ result in a dramatic decrease in the performance of 
component programming is thafit facilitates the use of 20 f? over »i a ^ om P a ° a raw ^ 

reusable sections of code. Programs wiU often provide a ^ catlon ^ XDd * data across the network, the 

■ -i «. 4- i-* c i a a DCOM overhead can decrease performance by a factor of 

similar functionality. For example, many modem software . r J 

applications provide pull -down menu functionality. Com- ree or more * 

puter code that allows a user to pull down a menu on the 25 SUMMARY OF THE INVENTION 

computer screen can be found in some form in each of these , . . . , , , _ 

applications. A component providing the same functionality, . Accordingly, the present invention provides a method for 

however, would only need to be written once, and then casing the j^ncy of calling remote objects over a 

simply reused by each succeeding application. The time netwonc using ulum. 

required to create an application, therefore, can be signifi- Th* P resent invention also provides a more efficient 

cantly reduced by reusing preexisting components. method of marshaling DCOM application data. 

For object-based component programming to be The invention additionally provides a method for maxi- 

successful, a standard method of interactions between mizin S the efficiency of RPC flow control, 

objects must be defined. One such standard is the Compo- The invention also provides for a more efficient binding 

nent Object Model, or COM. COM mandates that all objects 35 between the client and the server. 

interact through interfaces. Each interface is a collection of An object model, such as DCOM, can allow communi- 

functions that the object can perform. The object is said to cation across a network by making the network communi- 

have "exposed" the methods contained in its interfaces, cation transparent to the client and server objects. DCOM 

which can then be "called", or used, by another object. uses a "proxy" on the client process and a "stub" on the 

Another standard, based on COM is the Distributed Com- 40 server process to achieve such transparency. The proxy acts 

ponent Object Model, or DCOM. DCOM defines a standard as a local version of the server object which the client can 

method of interaction between objects that may be located call, and the stub acts as a local client object on the server, 

on remote computers connected through a network. DCOM The proxy and stub then communicate with one another 

uses a Remote Procedure Call (RPC) model to define a . across the network. To perform this communication, the 

method of communication between objects across a net- 45 proxy marshals the call parameters into an RPC buffer, from 

work. The RPC model is independent of the underlying which they are transferred across the network to the stub, 

network structure or protocols. The stub unmarshals the call parameters, and calls the server 

As can be expected, calling an object located on the same object directly. Similarly, on the return, the stub marshals the 

computer is faster than calling an object located on a remote ca ll results into an RPC buffer for transmission across the 

computer. This speed difference can be due to a number of 50 network to the proxy, which unmarshals the results and 

factors. The network cables are significantly longer than the returns them to the client process, 

leads between the processor and the memory on the local The present invention allows DCOM systems using a 

machine. Therefore, the electrical signals simply take longer network interface card (NIC) with "scatter-gather" ability to 

to reach the remote computer than to reach the object gather elements from various memory locations to avoid 

resident in memory on the local machine. A significantly 55 copying the call parameters into the RPC buffer. Instead, the 

larger factor is the overhead caused by the network protocol. proxy or stub simply create a pointer list in the buffer, which 

Each data transmission over a network must be is then accessed by the NIC, which can collect the elements 

encapsulated, and additional information must be added to from memory and is responsible for sending the data across 

the packet so that it may be transferred across the network the network. To indicate that the RPC buffer contains only 

with error correcting capabilities, and so that it may properly 60 a list and not the actual values themselves, the proxy or stub 

be decoded on the remote machine. Furthermore, each can set a flag, which is understood by the NIC or RPC 

packet sent over a network may be accompanied by a flurry runtime. On the server side, the stub code can hold onto the 

of additional network packets performing necessary buffer buffer and not clear it until the NIC has finished sending the 

management and receipt acknowledge functions. These fur- data. In such a case, a callback function can be used by the 

ther packets, which comprise the network flow control, also 65 NIC to indicate that it has completed sending the data, 

add to the time required to send an object call over a network Another method of improving the network performance 

to a remote computer. of an object model such as DCOM is to make more efficient 
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the communication between a client and a server through the 
RPC layer. DCOM was designed to take advantage of the 
existing architecture of RPC, provides a mechanism for 
making calls to remote computers connected by a network. 
When a local RPC object seeks to call a remote RPC 5 
interface, the call can specify the IP address, the port number 
and the RPC IID. DCOM takes advantage of the RPC 
structure, except that DCOM uses an interface pointer 
identifier (IPID) to uniquely specify the COM interface to 
which the call is being made. In order to use the RPC 10 
structure, the DCOM client object must send an RPC IID to 
the RPC runtime layer and an IPID to the DCOM runtime 
layer. Because the IPID is more specific than the RPC IID, 
the RPC IID is redundant and the additional computation 
performed by the RPC layer is wasted. 15 

The present invention removes the additional computa- 
tion and communication performed by RPC and allows the 
DCOM client to send only an IPID. The RPC dispatching 
layer on the server side is removed from the critical path. All 
incoming DCOM calls are forwarded to the DCOM dis- 2 o 
patching layer directly. The client side can then be modified, 
so that the calling DCOM object only needs to send an IPID. 
The removal of the RPC dispatching allows DCOM com- 
munication to proceed without a duplication of effort, and 
therefore more efficiendy. 25 

Yet another method of improving DCOM performance 
involves modifying the flow control performed by the soft- 
ware protocol stacks. When transmitting data, a buffer on the 
receiving side must be made available before each packet of 
data can be sent. Furthermore, the sender must know that the 30 
receiver has made a buffer available, using some form of 
flow control, before sending a message. With traditional 
transport layers, the sender waited for an explicit "OK TO 
SEND" flow-control message, thereby insuring that the 
receiver had sufficient resources to accept the data the sender 35 
was waiting to transmit. In the worst case, which can be 
typical for RPC and DCOM communication, the sending of 
each data packet requires the sending of one flow control 
packet, flow control packets account for one half of the 
network traffic. More importantly, the waiting computer 40 
does no useful work while waiting for the "OK TO SEND" 
flow control message. Such idle time reduces the efficiency 
of the overall system. 

The present invention modifies the RPC transport layer to 
use an implicit flow control. Implicit flow control does not 45 
require an explicit communication from the receiver indi- 
cating it is ready to receive; such as an "OK TO SEND" 
message. Rather, implicit flow control insures that the 
receiver is ready to receive by implicitly associating flow 
control messages with regular application messages. The 50 
present invention allows a sending computer to pre-post a 
receive buffer prior to sending out any data that may cause 
a response message to be sent from the receiving computer. 
Therefore, when the receiving computer receives the data 
from the sending computer, it is an implicit acknowledge- 55 
ment that the sending computer is ready to receive. By 
pre-posting the receive buffer prior to sending any data, the 
sending of data becomes an indication that the next receive 
buffer is ready. Thus, the regular application messages can 
be considered flow control messages. Such a system elimi- 60 
nates the overhead due to the standard flow control by 
relying on the request/reply semantics of RPC communica- 
tion. Additionally, the flow control of the present invention 
minimizes the idle time of the sending and receiving com- 
puters. By removing the explicit flow control messages, the 65 
present invention allows computers to reorganize their send 
and receive cycles to minimize idle time, and thereby 
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maximize efficiency. Note that the present invention is more 
efficient than prior systems, such as the standard TCP 
protocol, which piggyback explicit flow-control messages 
on outgoing application messages as often as possible. For 
example, the TCP heuristics to piggyback explicit flow 
control-messages fail to optimize flow-control in request- 
reply traffic between client and server, which is exactly the 
traffic for RPC, DCOM, and HTTP. 

Additional features and advantages of the invention will 
be made apparent from the following detailed description of 
illustrative embodiments which proceeds with reference to 
the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

While the appended claims set forth the features of the 
present invention with particularity, the invention, together 
with its objects and advantages, may be best understood 
from the following detailed description taken in conjunction 
with the accompanying drawings of which: 

FIG. 1 is a block diagram generally illustrating an exem- 
plary computer system on which the present invention 
resides; 

FIG. 2 is a block diagram generally illustrating the 
operation of DCOM over an exemplary network and com- 
puters; 

FIG. 3A is a block diagram generally illustrating the 
layers of DCOM on a client and the transfer of data from a 
client to a server; 

FIG. 3B is a block diagram generally illustrating the 
layers of DCOM on a server and the transfer of data from a 
client to a server; 

FIG. 4 A is a block diagram generally illustrating the 
layers of DCOM on a client and the transfer of data from a 
client to a server according to one aspect of the present 
invention; 

FIG. 4B is a block diagram generally illustrating the 
layers of DCOM on a server and the transfer of data from a 
client to a server according to one aspect of the present 
invention; 

FIG. 5A is a flow chart generally illustrating the layers of 
DCOM on a client and the transfer of data from a server to 
a client according to one aspect of the present invention; 

FIG. 5B is a flow chart generally illustrating the layers of 
DCOM on a server and the transfer of data from a server to 
a client according to one aspect of the present invention; 

FIG. 6 is a block diagram generally illustrating the 
operation of RPC dispatching and DCOM dispatching; 

FIG. 7 is a communication flow diagram generally illus- 
trating explicit flow control; 

FIG. 8 is a communication flow diagram generally illus- 
trating implicit flow control according to one aspect of the 
present invention; and 

FIG. 9 is a communication flow diagram generally illus- 
trating implicit flow control according to another aspect of 
the present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Turning to the drawings, wherein like reference numerals 
refer to like elements, the invention is illustrated as being 
implemented in a suitable computing environment. 
Although not required, the invention will be described in the 
general context of computer-executable instructions, such as 
program modules, being executed by a personal computer. 



04/06/2004, EAST Version: 1.4.1 



US 6,708,223 Bl 

5 6 

Generally, program modules include routines, programs, The personal computer 20 may operate in a networked 
objects, components, data structures, etc. that perform par- environment using logical connections to one or more 
ticular tasks or implement particular abstract data types. remote computers, such as a remote computer 49. The 
Moreover, those skilled in the art will appreciate that the remote computer 49 may be another personal computer, a 
invention may be practiced with other computer system 5 server, a router, a network PC, a peer device or other 
configurations, including hand -held devices, multi- common network node, and typically includes many or all of 
processor systems, microprocessor based or programmable the elements described above relative to the personal corn- 
consumer electronics, network PCs, minicomputers, main- puter 20, although only a memory storage device 50 has 
frame computers, and the like. The invention may also be been illustrated in FIG. 1. The logical connections depicted 
practiced in distributed computing environments where in FIG. 1 include a local area network (LAN) 51, a wide area 
tasks are performed by remote processing devices that are network (WAN) 52, and a high-speed system area network 
linked through a communications network. In a distributed (SAN) 56. Such networking environments are commonplace 
computing environment, program modules may be located in offices, enterprise-wide computer networks, intranets and 
in both local and remote memory storage devices. the Internet. 

With reference to FIG. 1, an exemplary system for imple- When used in a LAN networking environment, the per- 

menting the invention includes a general purpose computing 15 sonal computer 20 is connected to the local network 51 

device in the form of a conventional personal computer 20, through a network interface or adapter 53. When used in a 

including a processing unit 21, a system memory 22, and a WAN networking environment, the person computer 20 

system bus 23 that couples various system components typically includes a modem 54 or other means for establish- 

including the system memory to the processing unit 21. The ing communications over the WAN 52. The modem 54, 

system bus 23 may be any of several types of bus structures 20 which may be internal or external, is connected to the system 

including a memory bus or memory controller, a peripheral bus 23 via the serial port interface 46. When connected to a 

bus, and a local bus using any of a variety of bus architec- SAN, the personal computer 20 is connected via a high- 

tures. The system memory includes read only memory speed network interface 55. In a networked environment, 

(ROM) 24 and random access memory (RAM) 25. A basic program modules depicted relative to the personal computer 

input/output system (BIOS) 26, containing the basic routines 25 20, or portions thereof, may be stored in the remote memory 

that help to transfer information between elements within storage device. It will be appreciated that the network 

the personal computer 20, such as during start-up, is stored connections shown are exemplary and other means of estab- 

in ROM 24. The personal computer 20 further includes a lishing a communications link between the computers may 

hard disk drive 27 for reading from and writing to a hard disk be used. 

60, a magnetic disk drive 28 for reading from or writing to 30 In the description that follows, the invention will be 

a removable magnetic disk 29, and an optical disk drive 30 described with reference to acts and symbolic representa- 

for reading from or writing to a removable optical disk 31 tions of operations that are performed by one or more 

such as a CD ROM or other optical media. computers, unless indicated otherwise. As such, it will be 

The hard disk drive 27, magnetic disk drive 28, and understood that such acts and operations, which are at times 

optical disk drive 30 are connected to the system bus 23 by 35 referred to as being computer-executed, include the manipu- 

a hard disk drive interface 32, a magnetic disk drive inter- lation by the processing unit of the computer of electrical 

face 33, and an optical disk drive interface 34, respectively. signals representing data in a structured form. This manipu- 

The drives and their associated computer-readable media lation transforms the data or maintains it at locations in the 

provide nonvolatile storage of computer readable memory system of the computer, which reconfigures or 

instructions, data structures, program modules and other 40 otherwise alters the operation of the computer in a manner 

data for the personal computer 20. Although the exemplary well understood by those skilled in the art. The data struc- 

environment described herein employs a hard disk 60, a tures where data is maintained are physical locations of the 

removable magnetic disk 29, and a removable optical disk memory that have particular properties defined by the format 

31, it will be appreciated by those skilled in the art that other of the data. However, while the invention is being described 

types of computer readable media which can store data that 45 in the foregoing context, it is not meant to be limiting as 

is accessible by a computer, such as magnetic cassettes, flash those of skill in the art will appreciate that various of the acts 

memory cards, digital video disks, Bernoulli cartridges, and operation described hereinafter may also be imple- 

random access memories, read only memories, and the like mented in hardware. 

may also be used in the exemplary operating environment. In accordance with the invention, the interactions of a 

A number of program modules may be stored on the hard 50 distributed object model are shown in FIG. 2. An object 

disk 60, magnetic disk 29, optical disk 31, ROM 24 or RAM model can define a standard set of rules governing the 

25, including an operating system 35, one or more applica- interaction of "objects", such as objects 74 and 76. An 

tion programs 36, other program modules 37, and program object, as is known by those skilled in the art, is a computer 

data 38. A user may enter commands and information into program element comprising computer readable instructions 

the personal computer 20 through input devices such as a 55 and computer readable data. Objects can be very useful in 

keyboard 40 and a pointing device 42. Other input devices the programming arts because users can use previously 

(not shown) may include a microphone, joystick, game pad, programmed objects to create an application, instead of 

satellite dish, scanner, or the like. These and other input writing all of the code themselves. Objects, therefore, allow 

devices are often connected to the processing unit 21 for efficient code reuse. Once an object is created to perform 

through a serial port interface 46 that is coupled to the 60 specific tasks, any user can use that object to perform those 

system bus, but may be connected by other interfaces, such tasks. Thus, to implement common functionality across 

as a parallel port, game port or a universal serial bus (USB). different computer applications, the software author need 

A monitor 47 or other type of display device is also only create an object with that functionality once, or even 

connected to the system bus 23 via an interface, such as a find an object created by another, and then simply use it in 

video adapter 48. In addition to the monitor, personal 65 each application. 

computers typically include other peripheral output devices, An object model, such as the Component Object Model 

not shown, such as speakers and printers, (COM) from Microsoft Corporation, seeks to define a set of 
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standards so that objects written by one individual can be call, the DCOM run-time layer 124 transmits the call over 

used by all, without any changes to the object, and even the network. The DCOM run-time layer 124 transmits the 

without understanding how the object is implemented inter- call by invoking the functionality of the Remote Procedure 

nally. To accomplish this, object models can require objects Call (RPC) run-time layer 126. DCOM's structure allows it 

to implement interfaces. As will be known by one of skill in 5 to take advantage of the existing structure of RPC, as will be 

the art, an interface, such as interface 82 of object 76, is a explained below. The loadable transport layer 128 allows the 

set of functions provided by the object which a client of the systems above it to run on any number of different protocols, 

object can request. A client of an object can only interact which are implemented in the protocol stacks 130. The 

with an object through that object's interfaces. Therefore, if protocol stacks 130 then create the packets sent out over the 

an object is capable of performing a certain task, a function 30 network connection 90. On the server side, shown in FIG. 

for that task will exist in one of the object's interfaces. To 3B, the protocol stacks 132 receive the packets, translate 

request that the object perform a task, the client of the object them, and pass them to the loadable transport layer 134, 

can select an interface and make a call to the appropriate which further translates the data into a form which the RPC 

function. Because clients can only interact with an object run-time layer 136 can accept. The RPC run-time layer 136 

through its interfaces, the specific structure and internal 15 then accepts the communication, and creates a binding if the 

workings of the object are irrelevant. call is the first call to an interface. The DCOM run-time layer 

Due to the increasing popularity of networked computing, 138 accepts the communication from the RPC run-time layer 

it is desirable that objects can interact with one another over 136 and passes it to the stub 80 at the marshaling layer 140. 

a network. To maintain compatibility, and not require The stub 80 unmarshals the parameters of the call and 

rewriting, an object model which seeks to allow implemen- 2 o initiates the call to the DCOM server object 142. 

tation across a network can provide some mechanism for The present invention provides for a number of improve - 

transparent network communication. As seen from the cli- ments in this layered architecture; removing overhead, and 

ent's perspective, there should be no difference between increasing the speed of DCOM over the network connection 

calling an object on a local computer and an object on a 90. One such improvement can be made at the marshaling 

remote, networked computer. One such object model, the 2 $ layers 122 and 140. Marshaling is the process of arranging 

Distributed Component Object Model (DCOM) from the data provided by the DCOM client 120 when it calls the 

Microsoft Corporation, uses a "proxy" in the client process DCOM server object 142 into a proper form for transmission 

and a "stub" in the server process to achieve such transpar- across the network connection 90. Simple data types such as 

ency. characters and integers are not difficult to marshal. However, 

Turning again to FIG. 2, an interface 82 is shown exposed 30 DCOM often passes more complex parameters, such as 

by server object 76. As can be seen, server object 76 resides arrays of information. RPC can use a standard format called 

on server computer 72. Server computer 72 and client the Network Data Representation (NDR) to marshal the 

computer 70 are connected through a network connection data. DCOM, since it is built on top of RPC, as shown in 

90, which can be a SAN 56. In order to allow client object FIGS. 3A & 3B, can leverage RPC's functionality, such as 

74, resident on client computer 70, to call interface 82 of the 35 the use of the NDR standard format. As is known by those 

server object 76, DCOM creates a proxy 78 on the client of skill in the art, the NDR standard is a "receiver makes 

computer and a stub 80 on the server computer. The proxy right" standard. Should any translation of the data be nec- 

78 on the client computer 70 acts as the client-side repre- essary for a client computer and a server computer to 

sentative of the server object 76 by exposing an interface 84 communicate, it is the receiver's responsibility to convert 

analogous to interface 82 exposed by the server object. The 40 the data into the format it requires. Thus, it is the receiver 

client object 74 can therefore call interface 84 in exactly the which makes the data format "right" for itself. The sender, 

same manner it would call any local interface. Once the therefore, need not perform any conversion on the data, 

client object 74 calls interface 84, the proxy 78 transfers the With reference again to FIGS. 3A & 3B, the marshalling 

call across the network connection 90 to the stub 80. It is the layer 122, in FIG. 3A, using the NDR standard, marshals 

stub 80 which then calls the actual interface 82 of the server 45 data 144 by reading parameters, such as pointers to arrays, 

object 76. The server object 76 can respond in an analogous or pointers to integers, placed by the DCOM client 120 onto 

manner by sending the reply data to the stub 80 and having the memory stack 121 of the client computer 70. As is 

the stub transfer it across the network connection 90 to the known by those skilled in the art, a call to a function passes 

proxy 78, which then presents the data to the client object parameters including immediate data values, such as inte- 

74. Therefore, because the proxy 78 and the stub 80 are both 50 gers or floating-point numbers, and pointers to additional 

located on the same machine as the objects with which they data, such as pointers to arrays of data, pointers to text 

communicate, they allow those objects to make calls and strings, or pointers to complex data structures. Therefore, 

return data in exactly the same manner as they did in a local when the DCOM client 120 makes a call to the DCOM 

context. The proxy 78 and stub 80 then package the calls and server 142, it places onto the stack 121 a parameter set 125 

data and send them across the network, allowing for a 55 include immediate data and pointers for the current call. The 

distributed object system. The proxy 78 and stub 80, pointers in the parameter set 125 on the stack 121 point to 

therefore, make the network transparent to client object 74 the data 144 which is in the client computer memory 145. 

and server object 76. The marshalling layer 122 first determines the required size 

A known layered architecture of DCOM is shown in of the RPC buffer for holding all marshaled data and the 

FIGS. 3A & 3B. As shown in FIG. 3A, when the DCOM 60 DCOM header, and requests such a buffer 123. Then it 

client 120 makes a remote call, the marshaling layer 122 copies any immediate data in the parameter set 125 into the 

prepares the call for transmission across the network. The buffer. It also traverses all of the pointers in the parameter set 

proxy 78 acts as the marshaling layer 122 on the client 70 125 to retrieve all the data 144 and copies them into the RPC 

and the stub 80 acts as the marshaling layer 140 on the server buffer so that the call can be properly unmarshaled by the 

72. Marshaling, as will be explained in more detail below, is 65 marshaling layer 140, in FIG. 3B. The DCOM run-time 

the packaging of the call for transmission across the network layer 124 adds the DCOM header and passes the buffer to 

connection 90. After the marshaling layer 122 marshals the the RPC run-time layer, requesting that the data be sent 
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across the network. As will be known by one skilled in the 
art, an additional copy 129 may be made by the operating 
system and placed into a protected-mode socket buffer 131 
for transmission across network connection 90. At the server 
side, shown in FIG. 3B, the transmitted data 135 may be 5 
delivered into a protected-mode socket buffer 133 and from 
there into the RPC buffer 141. The marshaling layer 140 
unmarshals the marshaled data 137 from RPC buffer 141 
into the parameter set 139 and the server memory 147 on the 
server computer 72. After the pointers in the parameter set 10 
139 on the stack 143 have been recreated, the call made by 
the DCOM client 120 can then be made by the stub 140 to 
the DCOM server 142. 

As described above, to perform marshaling, the proxy 122 
copies immediate data from the parameter set 125 and 35 
additional data 144 to an RPC buffer 123 for transmission. 
This buffer holds a duplicate 127 of the parameter set 125 
and data, since the parameter set is still resident in the stack 

121 and the data is still resident in the memory 144 from 
which it was copied. The present invention contemplates a 20 
direct marshaling which stores only a list of pointers to the 
memory locations of the data (either in the parameter set 125 

or additional data 144) in the RPC buffer, rather than 
duplicating the data itself. As is known by those of skill in 
the art, a pointer is generally of much smaller memory size 2 5 
than the data it points to, especially in the case of pointers 
to large data arrays. Therefore, the speed at which the proxy 

122 and the stub 140 could marshal and unmarshal the 
parameters would be increased by copying only pointers into 
the RPC buffer. 30 

Certain network interface cards (NICs) provide for the 
ability to perform scatter-gather operations. One example of 
a network which can use the scatter-gather functionality of 
such a NIC is a network based on the Virtual Interface 
Architecture (VIA), which is an instance of a SAN. VIA 35 
allows network user-mode applications to directly request a 
scatter-gather mode of transmission without incurring the 
extra cost of a copy into a protected-mode buffer. The 
gathering and the sending of the data is performed directly 
by the NIC and requires no intervention by the host 40 
processor, thereby eliminating the kernel-mode protocol 
stacks 130 and 132. Furthermore, the request to send and 
receive data is presented by the user-mode application 
directly to the NIC without transitioning into the operating 
system kernel and associated device drivers. 45 

In accordance with the invention, and turning to FIGS. 4A 
& 4B, a modified proxy 198 marshals a list of pointers 125 
into the RPC buffer 123. An RPC flag can be added to the 
modified proxy 198 and stub 199, described in more detail 
below, to allow them to inform the RPC run-time layers 126 50 
and 136 that the RPC buffers 123 and 141 contain only a list 
of pointers to memory. The DCOM runtime layers 124 and 
138, as described above, can use the RPC layers to com- 
municate the call parameters across the network. Therefore, 
the DCOM layers only pass the flag indicating that direct 55 
marshalling is used, after adding or removing the DCOM 
header to or from the packet, in a manner analogous to that 
of the known system described above. The RPC runtime 
layers 126 and 136, however, can be modified to accept a 
larger data structure from the modified proxy 198 and stub 60 
199. The larger data structure can accommodate the flag set 
by the modified proxy 198 and stub 199. If the flag is set, the 
RPC run-time layers 126 and 136 interpret the data 152 and 
156 as a list of scatter-gather entries, each comprising a 
starting memory address of the data they point to and the 65 
length of the data. As shown in FIG. 4A, the RPC run-time 
layer 126 adds RPC headers to the list 152 and passes it to 
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the loadable transport layer 128. The loadable transport layer 
128 then passes the list to the user mode stack 148, which 
implements the implicit flow control, described in more 
detail below. The user mode stack 148 stores the list 153 in 
a list buffer 151. The NIC, at the VIA network connection 
layer 150, gathers the immediate data from the parameter set 
125 and additional data 144, both pointed to by the list 153, 
out of the stack 121 and the client memory 145 and transmits 
it across the network. 

On the receiving side, shown in FIG. 4B, since the 
servers-side RPC runtime may receive calls on any methods 
supported by the server process, it is in general not possible 
to specify a receive scatter list for any arbitrary method in 
advance. However, since the receiving RPC buffer is dedi- 
cated to the on-going RPC call for its entire duration, the 
stub code and the server object can use the data in the RPC 
buffer directly without first copying the data into the data 
146 in server memory 147, unless data format conversion is 
required. 

Turning to FIGS. 5A & 5B, a response from the DCOM 
server object 142 to the DCOM client 120 is shown. As 
shown in FIG. 5B, a modified stub 199 marshals a list of 
pointers 157 into an RPC buffer 141. The list of pointers 157 
contains entries for any immediate return data in the return 
parameter set 139 and any additional data 146 in server 
memory 147. An RPC flag can be added to the modified 
proxy 198 and stub 199, as described above, to allow them 
to inform the RPC run-time layers 126 and 136 that the RPC 
buffers 123 and 141 contain only a list of pointers to 
memory. In a manner analogous to that described above in 
reference to FIG. 4A & 4B, the DCOM run-time layer 138 
can add a DCOM header to the list. The RPC run-time layer 
136 can then add RPC headers to the list 157 and pass it to 
the loadable transport layer 134. The loadable transport layer 
134 then passes the list to the user mode stack 149, which 
implements the implicit flow control, described in more 
detail below. The user mode stack 149 stores the list 158 in 
a list buffer 153. The NIC, at the VIA network connection 
layer 150, gathers all the data pointed to by the list 158 and 
transmits it across the network. 

Because the NIC performs the gather and send operation 
directly from the server memory 147, the DCOM server 142 
should delay clearing the memory 147 until after the NIC 
has finished gathering and transmitting the data. If the 
DCOM server object 142 were to clear the memory prior to 
the completion of the send operation, the NIC would not be 
able to gather the appropriate data 146 pointed to by the 
pointers 158. To insure that the DCOM server object 142 
does not prematurely clear data 146 but can still reclaim the 
memory after its usage, a callback function can be imple- 
mented at the marshaling layer 199 to be invoked by the 
loadable transport layer 134. Initially, when the modified 
stub 199 intends to use the direct marshalling, it passes down 
to the loadable transport layer 134 a context pointer and a 
function pointer to the callback function. The loadable 
transport layer 134 then calls the callback function by 
supplying the context pointer as a parameter to indicate that 
the sending of the data 146 has completed. 

On the receiving side, shown in FIG. 5A, if the client 
knows the size of each piece of the returning data when it 
makes the call, it can pass down a list of pointers for 
scattering in 159. In this case, when the NIC receives the 
transmitted data, it can scatter it directly into data 144 in 
client memory 145, as instructed by the list of pointers 159. 
If the size of the returning data cannot be determined 
beforehand, the incoming data needs to be received by the 
RPC buffer 123 first. Unlike the server side, it is undesirable 
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for the client to use the data from buffer 123 directly because 
the client may need to hold on to the data beyond the end of 
current call. Therefore, the data 160 in buffer 123 needs to 
be copied to data 144 in client memory 145 so that the RPC 
buffer 123 can be released. 5 

The proxy 78 and stub 80 shown in FIG. 2 implement 
standard marshaling. Should a user choose to do so, they 
could write a modified proxy 198 and stub 199 to perform 
the direct marshaling of the present invention, as disclosed 
above. One method for doing so is to manually replace the 1Q 
copy marshalling code with code which constructs a scatter- 
gather list and to move the buffer release code into an added 
callback function. The pointer to the buffer, the context 
pointer, and the pointer to the callback function, as described 
above, are passed to the RPC run-time layer and loadable 
transport layers. Those layers, as also described above, can 15 
then invoke the callback function by supplying the context 
pointer as a parameter when the buffer can be released. An 
alternative method for generating a modified proxy 198 and 
stub 199 to perform the direct marshaling of the present 
invention would be to use an IDL compiler. An interface can 20 
be described by the Interface Definition Language (IDL). As 
is known by those skilled in the art, once an interface is 
defined in IDL, an IDL compiler can create the code for both 
a proxy and a stub capable of marshaling the defined 
interface. One such IDL compiler is the Microsoft IDL 2 s 
(MIDL) compiler from Microsoft Corporation. The IDL 
compiler could be modified to automatically produce a 
proxy and stub capable of providing such direct marshaling. 
Alternatively, a command-line flag could be provided to 
indicate that direct marshalling is requested. 30 

As can be seen, the present invention reduces the number 
of copies on the client side when calling an interface by 
marshaling only a list of pointers into the RPC buffer 123 
and allowing the network to access the data directly. On the 
server side, the received data can be retained in the RPC 35 
buffer 141, without copying to memory 147. Additionally, 
such lists of pointers can be used to eliminate a copy on the 
server side when sending a response from the DCOM server 
142, and when receiving the response on the client side. The 
elimination of these copies results in a more efficient transfer 40 
process from the DCOM client 120 to the DCOM server 142 
and from the server to the client. 

An additional optimization contemplated by the present 
invention is the removal of dispatching redundancies 
between the DCOM run-time layers 124 and 138 and the 45 
RPC run-time layers 126 and 136. As is known by those 
skilled in the art, dispatching is the process by which the 
called interface is located by the server computer 72. Gen- 
erally dispatching identifies an interface with succeeding 
levels of specificity. Turning to FIG. 6, RPC dispatching and 50 
DCOM dispatching on the server computer 72 are illus- 
trated. In order for a call from an RPC client to arrive at the 
correct server computer 72, the call can specify the Internet 
Protocol (IP) address of the server to which it is making the 
call. Each server can then have multiple port address on 55 
which a call can be made, and a port address can be specified 
in the call. The call can also specify the interface identifier 
(IID) of the RPC interface to which the call is made. 
Multiple interfaces can be called through a single port. Thus, 
as shown in FIG. 6, the server 72 first checks the IP address 60 
at step 170. If the IP address corresponds to the server 72, 
the server checks which port address is specified in the call 
at step 168. Once the port address is determined, the server 
can pass the call to the appropriate RPC dispatching at step 
166 which, depending on whether II Dl or IID2 was called 65 
can direct the call to interface IID1 at step 162 or interface 
IID2 at step 164. 
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DCOM dispatching is performed in a similar manner, 
since DCOM is layered on top of RPC, as can be seen from 
FIGS. 3A, 3B, 4A, 4B, 5A, and 5B. As shown in FIG. 6, the 
server 72 first checks the IP address at step 184. If the IP 
address corresponds to the server 72, the server checks 
which port address is specified in the call at step 182. Once 
the port address is determined, the server can pass the call 
to the appropriate DCOM dispatching element at step 180. 
Unlike RPC, however, a single DCOM object, such as object 
76 in FIG. 2 can have multiple interfaces, such as interface 
82. Because each interface has a unique interface identifier 
(IID) only within the object providing that interface, it is 
possible for two interfaces of two separate DCOM objects to 
have an identical IIDs. Furthermore, because multiple 
DCOM objects can be called through a single port, it is 
possible for two interfaces of two separate DCOM objects, 
each of which can be called through the same port, to have 
an identical IIDs. Therefore, to uniquely identify an inter- 
face in such an environment, DCOM can use an interface 
pointer identifier (IPID). The IPID is a combination of the 
IID of the interface, and the object identifier (OID) of the 
object providing the interface. In such a manner, the IPID 
can uniquely identify the interface by referencing both the 
IID and the OID. 

Therefore, in FIG. 6, when the server 72 passes the call to 
the DCOM dispatching element at step 180, the DCOM 
dispatching element determines the appropriate IPID to 
which the call is directed. The DCOM dispatching element 
at step 180 is also known as the stub manager, because it 
directs the call to the appropriate stub, such as stub 80 in 
FIG. 2, based on the IPID. Thus, in FIG. 6, if the call was 
directed to interface IPID1, the stub manager at step 180 can 
pass the call to stubl at step 176 to call the interface. 
Alternatively, if the call was directed to interface IPID2, the 
stub manager at step 180 can pass the call to stub2 at step 
178 to call the interface. As is known by those skilled in the 
art, a single stub can access multiple interfaces. Thus, it is 
not required that the stub manager at step 180 invoke a 
different stub for each call to a different interface. 

As can be seen, DCOM relies on an IPID, a combination 
of an IID and an OID to perform dispatching, while RPC 
relies only on the IID. Nevertheless, because of the simi- 
larities between the two systems, DCOM can be imple- 
mented to take advantage of RPC dispatching. The RPC 
run-time layer 136 implements an RPC dispatching 186 
layer, as shown in FIG. 6, and an additional layer 188 to 
handle further RPC duties. The RPC run-time layer 126 does 
not implement the dispatching layer 186, as a client com- 
puter does not dispatch a call. RPC layer 188 can include 
RPC security, RPC thread management, RPC socket con- 
nection management, and RPC association management. 
The DCOM run-time layer 138, which implements the 
DCOM dispatching 190, can be thought of as built on top of 
the RPC dispatching 186 and the RPC layer 188, as shown 
in FIG. 6. The DCOM run-time layer 124 on the client 
computer 70 does not implement dispatching, but can pro- 
vide DCOM security. To ensure that the RPC run-time layer 
126 and 136 is ready to send and receive calls, the DCOM 
run-time layer 124 can still specify an IID to which the call 
is directed. In such a way the RPC dispatching 186 on the 
server 72 can handle a DCOM call as it would an RPC call. 
However, the DCOM dispatching 190 can use an IPID to 
uniquely specify the interface to which the call is directed. 
The RPC IID is therefore redundant, and used solely for the 
purpose of utilizing the RPC layer 188. Furthermore, when 
the RPC dispatching 186 receives the IID, it performs 
additional functions, such as setting up a communication 
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dictionary, which are redundant in light of the DCOM flow control, the sender must wait until the receiver signals 

dispatching 190. The redundancy is significant because the it is ready to receive prior to sending a packet across the 

functions performed to enable RPC dispatching sometimes network. Thus, in FIG. 7, the client computer 70 waits at 

require a network communication from the client computer step 204 for the server computer 72 to indicate that it is ready 

70 to the server computer 72 and a return communication 5 10 receive. An OK TO SEND message can be one such 

from the server to the client. As is known by those skilled in indication that the computer is ready to receive. At step 200 

the art, communications across a network connection require tne server computer 72 can post a receive buffer. By posting 

significantly more time than communications local to the the receive buffer, the server computer 72 is setting aside 

client computer 70. memory in which to receive whatever data the client com- 

The present invention, therefore, contemplates removing 10 P uter 70 ^ «nd- Meanwhile, at step 204, the client 

the use of the RPC IID and the attendant inefficiencies while computer 70 is idling, waiting for permission to send the 

maintaining the useful RPC security, thread management, data - 0nce the *«vcr computer 72 has posted the receive 

socket connection management, and association manage- buffer al ste P 200 > il can wnd an 0K TO SEND messa g e 

ment. One method for doing so is to remove the RPC 202 * the clienl computer 70 receives the OK TO 

dispatching 186 and allow the DCOM run-time layer 124 to is SEND message 202, it can then proceed, at step 206 to send 

specify only an IPID. On the server computer 72, when the its re ^ uest to me computer 72. The request is sent as 

RPC run-time layer 136 completes the steps required by the data 208 ' whicn 18 received b y the server computer and 

RPC utility layer 188, such as confirming the authenticity of P laced ™ receive buffer at ste P 2 }° 0nce the rcc i uest has 

the client computer 70, it performs the RPC dispatching in been received, the server can perform whatever work is 

layer 186. However, as described above, the processing of 20 required by the request at step 212. When the server com- 

the RPC dispatching layer 186 is inefficient, as the DCOM P uler 72 has A™** lhe work which was requested by the 

dispatching layer 190 will perform its own dispatching when client > it idles, at step 214, waiting for the client to signal that 

the RPC dispatching is finished. Furthermore, the RPC it is ready to receive. The cUent computer can post its receive 

dispatching layer 186 will only provide a pointer into the buffer at ste P 216 ' and can ^en send an OK TO SEND 

DCOM dispatching layer 190. Therefore, the present inven- 25 message 218. When the server receives the OK TO SEND 

tion contemplates providing the pointer to the DCOM dis- message 218, it can send its response to the client's request 

patching layer 190 directly to the RPC utility layer 188. In al ste P 220 - ^ response data 222 is received by the client 

such a manner, when the RPC utility layer 188 completes its and can be P laced m the receive buffer at ste P 224 - 

tasks, it can pass the call directly to the DCOM dispatching As can be seen from FIG. 7, the known flow control 

layer 190. 30 protocol results in two OK TO SEND messages for each 

An additional modification which can be made as a result client request and server response. The flow control mes- 

of the change to the RPC run-time layer 136 described sa & es thus a ccount for 50% of the message traffic, 

above, is to remove those API calls to the RPC dispatching Furthermore, the efficiency of the system is reduced when 

186 from the DCOM run-time layer 138. An example of the me chent and ^ computers wait for one another to send 

APIs affected is shown in Table 1 below. As can be seen 35 explicit flow control messages, not performing any useful 

from the table, the API calls that can be removed are those work m the mte rim. The present invention contemplates 

that perform functions attendant with RPC dispatching. removing the overhead and the inefficiency of the known 

system by implementing an implicit flow control at the 

TABLE 1 loadable transport layers 128 and 134 and turning off the 

40 explicit flow control in the user mode stack 148 and 149. An 

rpc_status rpc_entry RpcServerinqif( implicit flow control relies on RPC semantics to ensure that 

S^SSJ S pc ? n * r ? 8 ! 8ter !!L , each packet sent has a destination that is capable of receiving 

RPC_STATUS RPC_ENTRY RpcScrvcrRcgistcrlfExf . . .. . . . • • 

rpc_status rpc_entry RpcScrvcrUnrcgistcrift The implicit flow control of the present invenuon is 

rpc_status rpc_entry RpcScrvcrUscAiiProtscqsif( shown in FIG. 8. As can be seen, neither of the OK TO 

rpc_status rpc_entry RpcScrvcrUseAiiProtscqsi£Ex( 45 SEND explicit flow control transmissions of FIG. 7 are 

S£E£5 S^SSS WZZSSSg* ^ 11,6 expHci ! flow „ contro1 ?r age r an be t elimi - 

nated because, prior to sending any data, each computer can 

first pre-post a receive buffer. Therefore, the very act of 

On the client computer 70, the DCOM run-time layer 124 sending a message is an indication to the other computer that 

can be modified by removing the code that sends the IID 50 the receive buffer is already posted and the computer is 

together with the IPID. Because the server 72 no longer ready to receive. Thus, the other computer need not wait for 

performs RPC dispatching prior to DCOM dispatching, an explicit flow control message; rather the receipt of any 

there is no longer a need for the IID. As was described message is an implicit OK TO SEND. This implicit flow 

above, the IPID uniquely identifies the interface called, and control, as will be described in more detail with reference to 

is (conceptually) composed of a combination of the IID and 55 FIG. 8, allows for the removal of the flow control messages, 

the OID. Therefore, efficiencies are achieved due to the Furthermore, as will be described in more detail with 

elimination of repeated tasks between the DCOM run-time reference to FIG. 9, the implicit flow control of the present 

layer 138 the RPC run-time layer 136 on the server machine; invention can increase the efficiency of the overall system by 

most notably the RPC run-time layer 136 no longer performs reducing the unproductive computer time spent waiting for 

a round-trip network communication when the call is first 60 explicit flow control messages to be sent, 

initiated. The implicit flow control of the present invention requires 

Another improvement to the speed at which DCOM runs the size of the pre-posted buffer to be sufficiently large so 

over a network can be achieved through a modification of that it may accept whatever data was sent. Generally a 

the RPC flow control. Flow control ensures that each packet default size can be chosen, such as the Maximum Transfer 

sent across a network is being expected by the intended 65 Unit (MTU) of the network. An overflow of the pre-posted 

recipient. FIG. 7 illustrates a known flow control scheme, buffer will result in an error and a request to resend the data, 

which uses an explicit flow control. With such an explicit delaying processing of the data. As an alternative, a default 
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size smaller than the MTU could be chosen, decreasing the computer to another, such as the send operations in steps 232 

amount of resources used, but increasing the number of and 242 of FIG. 8, requires that the data 234 and 244 be 

overflows and resend requests, and thereby decreasing the placed in a send buffer for transmission. Therefore, there 

overall speed of the system. also exist send buffers which can also be cleared, in a 

In an RPC context, there can exist non-RPC communi- 5 manner analogous to the clearing of the receive buffers, 

cation. A non-RPC communication is a communication in In the known explicit flow control, the client and the 

which at least one of the two parties has no receive operation server could clear the buffers while waiting for an explicit 

following its send operation. In such a case, the optimized OK TO SEND message. The present invention, however, 

flow control may not be applicable, because the total number provides greater flexibility with respect to the timing of the 

of messages is not an even number. One example of such a 10 clear send buffer and clear receive buffer operations. Those 

non-RPC communication is an authentication between a operations can be delayed so that a computer can receive a 

client and a server. Authentication can be of the form: request, perform work, and return a result in the least amount 

request by client, challenge with counter-challenge by of time, thereby increasing the overall efficiency of the 

server, and response by client. This sequence of three system. FIG. 9 illustrates the sequence of the buffer clearing 

messages can be made to maintain RPC semantics by simply 15 operations, as contemplated by the present invention. As 

adding a fourth message back to the client from the server. with FIG. 8, FIG. 9 illustrates a steady-state system. The 

Alternatively, the client's first method call can be combined index shown in FIG. 9 indicates the round of communication 

with the third authentication message, the response by the between the client and server computers. Because FIG. 9 

client, so that one message accomplishes both functions, and illustrates a steady-state system, which can exist at any time, 

an even number of messages is maintained. 20 the index n is used to indicate any integer. Thus, the receive 

FIG. 8 illustrates a steady-state situation in the implicit buffer posted at step 250 will receive the nth response from 

flow control case. Initially, the server computer 72 can post the server computer. As will be described later, at step 268 

a receive buffer so that it may be able to receive a message the client computer pre-posts a receive buffer which will 

from the client computer 70. In FIG. 8, it is assumed that the receive the next response from the server, or the n+lth 

receive buffer used at step 236 was posted in a prior 2 5 response. 

sequence. Therefore, beginning with step 230, the client As described in detail above, the implicit flow control of 

computer 70 pre-posts a receive buffer. Once the client the present invention contemplates that the receive buffers 

computer 70 has posted the receive buffer, it can send its can be posted prior to the sending of any data, so that the 

request to the server. Thus, at step 232, the client sends data sending of the data itself is the implicit OK TO SEND 

234 to the server. The server, at step 236, places the data 234 30 message to the other computer. Thus, prior to sending the nth 

into the receive buffer that was posted during an earlier request at step 252, the client computer 70 pre-posts the 

cycle, as described above. At step 238, the server computer receive buffer at step 250 to accept the response to the nth 

72 can perform the work requested by the client. At step 240, request: the nth response. At step 251 the client 70 performs 

prior to sending the response to the client, the server can the work which necessitates the request to the server 72. The 

pre-post a receive buffer. Once the receive buffer is posted, 35 client can then send the request at step 252 as data 254. At 

at step 242 the server computer 72 can send to the client step 256, the server computer 72 receives the data 254 into 

computer 70 data 244, which can be placed by the client in a receive buffer which was posted during an earlier cycle, 

the receive buffer at step 246. The receive buffer into which not shown. As can be seen from the figure, prior to the 

the response is placed at step 246 is the receive buffer which receipt of the nth request from the client at step 256, the 

was posted at step 230. The sending of data 234 to the server 4Q server computer cleared, at step 253, the receive buffer from 

was an implicit OK TO SEND from the client to the server. the request prior to the nth request, the n-lth request. 

Thus, at step 242, the server could send the response data Similarly, at step 255, the server computer 72 cleared the 

244 without waiting for an explicit OK TO SEND. send buffer from the n-lth reply. Therefore, the buffers 

As explained above, an explicit flow control system which are cleared are those from the round of communica- 

reduces the efficiency of the overall system by requiring 45 tion prior to the current round. 

each computer to idle while waiting for an explicit OK TO At step 258, the server does work on the request, and at 

SEND flow control message. The implicit flow control of the step 260, the server pre-posts the receive buffer for the 

present invention can improve the system efficiency by coming request, the n+lth request. At step 262 the server 

reducing the amount of time each computer idles waiting for sends the response to the request of the current round, the nth 

explicit flow control messages. As can be seen with refer- 50 round, and that is received by the client at step 266 into the 

ence to FIG. 8, when the server computer 72 has finished its receive buffer which was posted at step 250. While the 

computations at step 238, it is ready to send the response server computer 72 was performing work at step 258, the 

data 244 to the client computer 70. The server 72 need not client computer 70 cleared the receive buffer from the prior 

wait for an explicit flow control message. Rather, it can send round, the n-lth round in step 261 and cleared the send 

data 244 as soon as it has pre-posted the receive buffer 240. 55 buffer from the prior round in step 263, as shown in FIG. 9. 

Thus, the amount of time between the completion of work Similarly, after the server 72 sent the response at step 262, 

at step 238 and the sending of the response at step 242 is it cleared the receive buffer at step 267 and the send buffer 

minimized. The client computer 70, therefore, receives a at step 274. The send buffer cleared in step 274 was the 

result from the server 72 in less time than in the known buffer used to send the response in step 262. 

explicit flow control environment. 60 The cycle of pre-post receive buffer, perform work, send 

As will be known by those skilled in the art, in addition request or reply, clean up receive, clean up send, and receive 

to posting receive buffers, each computer can clear those reply or request repeats itself for each request and response 

buffers once the data stored therein is no longer needed by cycle. A second cycle is illustrated in FIG. 9, as steps 268 

the computer. In such a manner the same physical memory through 285. The second cycle reveals that the clean up 

of a computer can be reused, ensuring that communication 65 operations are interleaved with the send and receive 

can continue indefinitely. Furthermore, as is also known by operations, and trail by one round. For example, the buffer 

those of skill in the art, the sending of data from one pre-posted at step 250 by the client receives data at step 266 
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and is cleared at step 279. Similarly, the send buffer used by 
the client at step 252 is cleaned up at step 281. On the server 
side, the buffer into which data was received at step 256 is 
cleared in step 267. Also on the server, the receive buffer that 
was pre-posted in step 260 received data in step 276, and the 5 
send operation in step 262 was cleaned up in step 274. 

Because the implicit flow control of the present invention 
allows the clean up operations to be flexibly timed, they can 
be scheduled to take place during the time in which the 
computer is waiting for a response. For example, when the 3 o 
client computer 70 sends the request at step 252, it may not 
be able to do substantive work until it receives a reply at step 
266. Therefore, scheduling buffer clearing operations, such 
as those at steps 261 and 263 in the time between step 252 
and 264 provides for efficiencies at the client side. At the ]5 
server side, the server 72 can decrease the time the client 
may be waiting for a response by decreasing the time 
between step 256 when it receives a request, and step 262 
when it sends the response. Thus, in the interim, the server 
72 only performs the work requested by the client, at step 2 o 
258, and preposts the receive buffer at step 260, as contem- 
plated by the implicit flow control of the present invention. 
The server 72 can then clear its buffers after step 262 when 
the client may no longer be waiting for it to respond to the 
client's request. As can be seen, by scheduling the clearing 2 5 
of the send and receive buffers outside of the receive 
operation and the responding send operation cycle, the 
overall efficiency of the system can be increased by decreas- 
ing the time each computer waits for the other to respond. 

The present invention provides three mechanisms for 30 
enhancing the speed of DCOM over a network. At the 
application level, copying is reduced by using an array of 
pointers rather than the values themselves and taking advan- 
tage of the network interface card's ability to do scatter- 
gather. The duplication of effort between the RPC runtime 35 
and the DCOM runtime is eliminated by removing the 
dispatching of the RPC runtime layer. Finally, at the trans- 
port level, the flow control is accelerated by switching to an 
implicit flow control, and scheduling the clear buffers com- 
mands outside of the critical time to reduce idle. Each of the 40 
three mechanisms can be used by themselves or in any 
combination to achieve a speed increase over the prior art. 

All of the references cited herein, including patents, 
patent applications, and publications, are hereby incorpo- 
rated in their entireties by reference. In view of the many 45 
possible embodiments to which the principles of this inven- 
tion may be applied, it should be recognized that the 
embodiment described herein with respect to the drawing 
figures is meant to be illustrative only and should not be 
taken as limiting the scope of invention. For example, those 50 
of skill in the art will recognize that the elements of the 
illustrated embodiment shown in software may be imple- 
mented in hardware and vice versa or that the illustrated 
embodiment can be modified in arrangement and detail 
without departing from the spirit of the invention. Therefore, 55 
the invention as described herein contemplates all such 
embodiments as may come within the scope of the following 
claims and equivalents thereof. 

We claim: 

1. A method of communication, using the Remote Proce- 60 
dure Call model, between a first object located on a first 
computer and a second object located on a second computer, 
the first and second objects conforming to the Distributed 
Component Object Model, the first and second computers 
connected by a network, the method comprising: calling an 65 
interface of the second object by the first object on the first 
computer, wherein the interface of the second object is 
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identified only with a DCOM interface pointer identifier; 
performing RPC utility functions on the call at the first 
computer; and communicating the call to the second 
computer, wherein the second computer receives the call, 
performs RPC utility functions on the call, passes the call to 
a DCOM dispatching function so as to bypass an RPC 
dispatching function, invokes a stub, and accesses the inter- 
face of the second object identified by the DCOM interface 
pointer identifier. 

2. The method of claim 1 wherein the calling of the 
interface comprises: posting, on the first computer, a first 
send buffer and a first receive buffer prior to sending a first 
data to the second computer, wherein the first receive buffer 
will receive a second data from the second computer, and 
wherein the first receive buffer is posted to be of sufficient 
size to accept the second data; and sending the first data to 
the second computer via the first send buffer. 

3. The method of claim 2 wherein the calling further 
comprises: cleaning up, on the first computer, a second 
receive buffer after sending the first data to the second 
computer and prior to receiving the second data from the 
second computer. 

4. The method of claim 2 wherein the calling further 
comprises: cleaning up, on the first computer, a second send 
buffer after sending the first data to the second computer and 
prior to receiving the second data from the second computer. 

5. The method of claim 2 wherein the second data from 
the second computer is in response to the first data from the 
first computer. 

6. The method of claim 1 wherein the first computer has 
a first memory location and a buffer, and access to the 
network through an interface card on the first computer, the 
method further comprising: placing in the buffer a copy of 
a first pointer to a first parameter, wherein the first parameter 
is used in the calling of the interface of the second object and 
wherein the first pointer points to the first parameter in the 
first memory location; and transmitting, by the network 
interface card, the first parameter pointed to by the first 
pointer by reading the first parameter out of the first memory 
location. 

7. The method of claim 6 further comprising issuing a 
notification on the first computer after the network interface 
card has finished reading the first parameter out of the first 
memory location. 

8. The method of claim 7 further comprising reclaiming 
the first memory location after receiving the notification. 

9. The method of claim 6 further comprising: placing in 
the buffer a copy of the first pointer to the first parameter and 
a copy of a second pointer to a second parameter, wherein 
the second parameter is used in the calling of the interface 
of the second object and wherein the second pointer points 
to the second parameter in a second memory location on the 
first computer; and transmitting, by the network interface 
card, the first parameter pointed to by the first pointer by 
reading the parameter out of the first memory location and 
the second parameter pointed to by the second pointer by 
reading the second parameter out of the second memory 
location. 

10. The method of claim 9 further comprising issuing a 
first notification on the first computer after the network 
interface card has finished reading the first parameter out of 
the first memory location and issuing a second notification 
on the first computer after the network interface card has 
finished reading the second parameter out of the second 
memory location. 

11. The method of claim 10 further comprising reclaiming 
the first memory location after receiving the first notification 
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and reclaiming the second memory location after receiving 
the second notification. 

12. The method of claim 6 wherein the transmitting 
comprises: posting, on the first computer, a first send buffer 
and a first receive buffer prior to sending a first data to the 5 
second computer, wherein the first receive buffer will 
receive a second data from the second computer, and 
wherein the first receive buffer is posted to be of sufficient 
size to accept the second data; and sending the first data to 
the second computer via the first send buffer. jo 

13. The method of claim 12 wherein the transmitting 
further comprises: cleaning up, on the first computer, a 
second receive buffer after sending the first data to the 
second computer and prior to receiving the second data from 
the second computer. is 

14. The method of claim 12 wherein the transmitting 
further comprises: cleaning up, on the first computer, a 
second send buffer after sending the first data to the second 
computer and prior to receiving the second data from the 
second computer. 20 

15. The method of claim 12 wherein the second data from 
the second computer is in response to the first data from the 
first computer. 

16. A computer-readable medium having computer- 
executable instructions for using the Remote Procedure Call 25 
model to enable communications between a first object 
located on a first computer and a second object located on a 
second computer, the first and second objects conforming to 
the Distributed Component Object Model, the first and 
second computers connected by a network, the computer- 30 
executable instructions performing steps comprising: calling 

an interface of the second object by the first object on the 
first computer, wherein the interface of the second object is 
identified only with a DCOM interface pointer identifier; 
performing RPC utility functions on the call at the first 35 
computer; and communicating the call to the second 
computer, wherein the second computer receives the call, 
performs RPC utility functions on the call, passes the call to 
a DCOM dispatching function so as to bypass an RPC 
dispatching function, invokes a stub, and accesses the inter- 40 
face of the second object identified by the DCOM interface 
pointer identifier. 

17. The computer-readable medium of claim 16 wherein 
the calling of the interface comprises: posting, on the first 
computer, a first send buffer and a first receive buffer prior 45 
to sending a first data to the second computer, wherein the 
first receive buffer will receive a second data from the 
second computer, and wherein the first receive buffer is 
posted to be of sufficient size to accept the second data; and 
sending the first data to the second computer via the first 50 
send buffer. 

18. The computer-readable medium of claim 17 wherein 
the calling further comprises: cleaning up, on the first 
computer, a second receive buffer after sending the first data 

to the second computer and prior to receiving the second 55 
data from the second computer. 

19. The computer-readable medium of claim 17 wherein 
the calling further comprises: cleaning up, on the first 
computer, a second send buffer after sending the first data to 
the second computer and prior to receiving the second data 60 
from the second computer. 

20. The computer-readable medium of claim 17 wherein 
the second data from the second computer is in response to 
the first data from the first computer. 

21. The computer-readable medium of claim 16, wherein 65 
the first computer has a first memory location and a buffer, 
and access to the network through an interface card on the 
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first computer, having further computer-executable instruc- 
tions for performing steps comprising: placing in the buffer 
a copy of a first pointer to a first parameter, wherein the first 
parameter is used in the calling of the interface of the second 
object and wherein the first pointer points to the first 
parameter in the first memory location; and transmitting, by 
the network interface card, the first parameter pointed to by 
the first pointer by reading the first parameter out of the first 
memory location. 

22. The computer-readable medium of claim 21 having 
further computer-executable instructions for performing 
steps comprising: issuing a notification on the first computer 
after the network interface card has finished reading the first 
parameter out of the first memory location. 

23. The computer-readable medium of claim 22 having 
further computer-executable instructions for performing 
steps comprising: reclaiming the first memory location after 
receiving the notification. 

24. The computer-readable medium of claim 21 having 
further computer-executable instructions for performing 
steps comprising: placing in the buffer a copy of the first 
pointer to the first parameter and a copy of a second pointer 
to a second parameter, wherein the second parameter is used 
in the calling of the interface of the second object and 
wherein the second pointer points to the second parameter in 
a second memory location on the first computer; and 
transmitting, by the network interface card, the first param- 
eter pointed to by the first pointer by reading the parameter 
out of the first memory location and the second parameter 
pointed to by the second pointer by reading the second 
parameter out of the second memory location. 

25. The computer-readable medium of claim 24 having 
further computer-executable instructions for performing 
steps comprising: issuing a first notification on the first 
computer after the network interface has finished reading the 
first parameter out of the first memory location and issuing 
a second notification on the first computer after the network 
interface card has finished reading the second parameter out 
of the second memory location. 

26. The computer-readable medium of claim 25 having 
further computer-executable instructions for performing 
steps comprising: reclaiming the first memory location after 
receiving a notification and reclaiming the second memory 
location after receiving the second notification. 

27. The computer-readable medium of claim 21 wherein 
the transmitting comprises: posting, on the first computer, a 
first send buffer and a first receive buffer prior to sending a 
first data to the second computer, wherein the first receive 
buffer will receive a second data from the second computer, 
and wherein the first receive buffer is posted to be of 
sufficient size to accept the second data; and sending the first 
data to the second computer via the first send buffer. 

28. The computer-readable medium of claim 27 wherein 
the transmitting further comprises: cleaning up, on the first 
computer, a second receive buffer after sending the first data 
to the second computer and prior to receiving the second 
data from the second computer. 

29. The computer-readable medium of claim 27 wherein 
the transmitting further comprises: cleaning up, on the first 
computer, a second send buffer after sending the first data to 
the second computer and prior to receiving the second data 
from the second computer. 

30. The computer-readable medium of claim 27 wherein 
the second data from the second computer is in response to 
the first data from the first computer. 

31. A method of communication, using the Remote Pro- 
cedure Call model, between a first object located on a first 
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computer and a second object located on a second computer, model to enable communications between a first object 
the first and second objects conforming to the Distributed located on a first computer and a second object located on a 
Component Object Model, the first and second computers second computer, the first and second objects conforming to 
connected by a network, the method comprising: receiving, the Distributed Component Object Model, the first and 
at the second computer, a call to an interface of the second 5 second computers connected by a network, the computer- 
object from the first object on the first computer, wherein the executable instructions performing steps comprising: 
interface of the second object is identified only with a receiving, at the second computer, a call to an interface of 
DCOM interface pointer identifier; performing RPC utility th f object from the first object on the first computer, 
functions on the received call; passing the received call to a W *™V^™* d ™ of ^ seC0 ° d 15 1 j enU ? ed ^ 
DCOM dispatching function so as to bypass an RPC dis- 10 ™.! h t a ? C ° M inicii ™ ^^dentifier; performing RPC 
*u- t *• • i- *u j utility functions on the received call; passing the received 
patching function; involang a stub; and > acces^ng the inter- ^ £ a rjcOM dispatching function so as to bypass an RPC 
face of the second object identified by the DCOM interface dispatching functi( f n . invo \ ing a stub; and ^ essing the 

P°™ te ;j denhft * r - r . • • interface of the second object identified by the DCOM 

32. The method of claim 31 wherein the receiving com- interface pointer identifier. 

prises: storing, on the second computer, a second data into 15 45 ^e computer-readable medium of claim 44 wherein 

a first receive buffer, wherein the first receive buffer was me receiving comprises: storing, on the second computer, a 

posted prior to sending a first data to the first computer. second data into a first receive buffer, wherein the first 

33. The method of claim 32 wherein the first data to the receive buffer was posted prior to sending a first data to the 
first computer was sent prior to receiving the second data first computer. 

from the first computer. 20 46. The computer-readable medium of claim 45 wherein 

34. The method of claim 32 wherein the receiving further the first data to the first computer was sent prior to receiving 
comprises: cleaning up, on the second computer, a send the second data from the first computer. 

buffer after sending the first data to the first computer and 47. The computer-readable medium of claim 45 wherein 

prior to receiving the second data from the first computer. lne receiving further comprises: cleaning up, on the second 

35. The method of claim 32 wherein the receiving further 25 computer, a send buffer after sending the first data to the first 
comprises: cleaning up, on the second computer, a second computer and prior to receiving the second data from the 

receive buffer after sending the first data to the first computer first computer. 

and prior to receiving the second data from the first com- 48 The computer-readable medium of claim wherein the 

t receiving further comprises: cleaning up, on the second 

36! The method of claim 31 wherein the second computer 30 ^T^',* ^ ""T ^ afier . s ? nd ** ^ a 

, 4 . j . to the first computer and prior to receiving the second data 

has a memory storage location and a buffer, and access to the from tfae fifSt computer 

network through a network interface card on the second 49 ^ ^puter-readable medium of claim 44, wherein 
computer, the method further comprising: receiving a call the mmpata has a memory storage location and a 
from the first object on the interface of the second object; 5ufferf and access t0 the ne twork through a network interface 
receiving, by the network interface card, a parameter of the 35 carc j on me second computer, having further computer- 
call from the first object; storing the parameter in a memory executable instructions for performing steps comprising: 
location; and accessing, by the second object, the parameter. receiving a call from the first object on the interface of the 

37. ITie method of claim 36 wherein the memory location second object; receiving, by the network interface card, a 
is the buffer, and wherein the accessing the parameter is parameter of the call from the first object; storing the 
performed in the buffer. 40 parameter in a memory location; and accessing, by the 

38. The method of claim 37 further comprising copying second object, the parameter. 

the parameter from the buffer into the memory storage 50. The computer-readable medium of claim 49 wherein 

location, wherein the accessing the parameter is performed the memory location is the buffer, and wherein the accessing 

in the memory storage location. the parameter is performed in the buffer. 

39. The method of claim 36 wherein the memory location 45 51. The computer-readable medium of claim 50 having 
is the memory storage location, and wherein the accessing further computer-executable instructions for performing 
the parameter is performed in the memory storage location. steps comprising: copying the parameter from the buffer into 

40. The method of claim 36 wherein the receiving com- the memory storage location, wherein the accessing the 
prises: storing, on the second computer, a second data into parameter is performed in the memory storage location. 

a first receive buffer, wherein the first receive buffer was 50 52. The computer-readable medium of claim 49 wherein 

posted prior to sending a first data to the first computer, and the memory location is the memory storage location, and 

wherein the first receive buffer was posted to be of sufficient wherein the accessing the parameter is performed in the 

size to accept the second data. memory storage location. 

41. The method of claim 40 wherein the first data to the 53, The computer-readable medium of claim 49 wherein 
first computer was sent prior to receiving the second data 55 the receiving comprises: storing, on the second computer, a 
from the first computer. second data into a first receive buffer, wherein the first 

42. The method of claim 40 wherein the receiving further receive buffer was posted prior to sending a first data to the 
comprises: cleaning up, on the second computer, a send first computer, and wherein the first receive buffer was 
buffer after sending the first data to the first computer and posted to be of sufficient size to accept the second data, 
prior to receiving the second data from the first computer. 60 54. The computer-readable medium of claim 53 wherein 

43. The method of claim 40 wherein the receiving farther the first data to the first computer was sent prior to receiving 
comprises: cleaning up, on the second computer, a second the second data from the first computer. 

receive buffer after sending the first data to the first computer 55, The computer-readable medium of claim 53 wherein 

and prior to receiving the second data from the first com- the receiving further comprises: cleaning up, on the second 

puter. 65 computer, a send buffer after sending the first data to the first 

44. A computer-readable medium having computer- computer and prior to receiving the second data from the 
executable instructions for using the Remote Procedure Call first computer. 
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56. The computer-readable medium of claim 53 wherein 
the receiving further comprises: cleaning up, on the second 
computer, a second receive buffer after sending the first data 
to the first computer and prior to receiving the second data 
from the first computer. 5 

57. A computing device comprising: an object conforming 
to the Distributed Component Object Model, the object 
comprising an interface that is called by a second object on 
a second computing device, wherein the interface is identi- 
fied only with a DCOM interface pointer identifier; a net- 10 
work connection, wherein the network connection commu- 
nicationally connects the computing device to the second 
computing device; a Remote Procedure Call utility layer, 
wherein the RPC utility layer performs RPC utility functions 
on the interface call by the second object and passes the 15 
interface call to a DCOM dispatching function so as to 
bypass an RPC dispatching function; and a DCOM dispatch- 
ing layer comprising the DCOM dispatching function, 
wherein the DCOM dispatching layer invokes a stub and 
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accesses the interface identified by the DCOM interface 
pointer identifier. 

58. A computing device comprising: an object conforming 
to the Distributed Component Object Model, the object 
calling an interface of a second object on a second comput- 
ing device, wherein the interface is identified only with a 
DCOM interface pointer identifier; a Remote Procedure Call 
utility layer, wherein the RPC utility layer performs RPC 
utility functions on the call; and a network connection, 
wherein the network connection communicates the call to 
the second computing device, and wherein further the sec- 
ond computing device receives the call, performs RPC 
utility functions on the call, passes the call to a DCOM 
dispatching function so as to bypass an RPC dispatching 
function, invokes a stub, and accesses the interface of the 
second object identified by the DCOM interface pointer 
identifier. 
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